ALTERNATING RATE PROFILE OPTIMIZATION 
IN SINGLE STREAM MIMO INTERFERENCE CHANNELS 



Rami Mochaourab 

Fraunhofer Heinrich Hertz Institute 
Berlin, Germany 

ABSTRACT 

We consider a set of transmitter- receiver pairs operating concur- 
rently in the same spectral band. The transmitters and receivers are 
equipped with multiple antennas and are restricted to apply single 
stream beamforming. This setting corresponds to the single stream 
multiple-input multiple-output (MIMO) interference channel. We 
assume perfect channel state information at the transmitters and the 
single-user decoding receivers. Efficient operating points in this set- 
ting correspond to points on the Pareto boundary of the achievable 
rate region. Characterizing all Pareto optimal points in the MIMO 
interference channel is still an unsolved problem. An approach 
to attain different Pareto optimal points in the MIMO interference 
channel is rate profile optimization. Given the nonconvexity of the 
problem, we propose an alternating approach based on successive 
optimization of the transmit and receive beamforming vectors. For 
fixed receive beamforming vectors, a solution for the rate profile 
optimization exists and is solved by a set of convex feasibility prob- 
lems. For fixed transmit beamforming vectors, we show that the rate 
profile optimization can be solved by a set of feasibility problems 
each corresponding to an inverse field of values problem. The con- 
vergence of the alternating algorithm is guaranteed to a stationary 
point of the original problem. 

Index Terms — MIMO interference channel; single stream 
beamforming; rate profile optimization; alternating optimization; 
Pareto optimality 



1. INTRODUCTION 

We consider multiple transmitter-receiver pairs (links) which simul- 
taneously utilize the same spectral band. Each transmitter sends a 
single data stream of useful information to its intended receiver, and 
each receiver treats the interference signals from unintended trans- 
mitters as additive noise. We assume the transmitters and receivers 
use multiple antennas. This setting corresponds to the single stream 
multiple-input multiple-output (MIMO) interference channel. 

Using models from noncooperative game theory, strategic games 
between the links are studied in Q]|2). The conditions for the global 
stability of the Nash equilibrium in MIMO interference channels are 
characterized in IT]. In order to improve the performance of the non- 
cooperative links, interference pricing schemes have been studied in 
(2) . Cooperative mechanisms in the MIMO interference channel are 
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proposed in [5][4). In (3J, the transmit and receive strategies are 
updated to balance the egoistic and altruistic behaviour of the links. 
In (4), different generalisations of interference alignment algorithms 
are proposed. 

Efficient operating points in the MIMO interference channel cor- 
respond to the Pareto optimal points. At these points, it is impossible 
to increase the rate of one link without degrading the performance of 
at least another link. In the MIMO interference channel, the problem 
of finding specific Pareto optimal points such as the maximum sum- 
rate and the proportional fair operating points are NP-hard problems 
even for single antenna receivers [5 1. Also, it has been proven that 
finding the max-min fair operating point in the MIMO interference 
channel is a strongly NP-hard problem (5). 

Existing approaches to characterize the Pareto optimal points in 
the MIMO interference channel are reported in [7 8. |5). In Q, 
MIMO interfering broadcast channels are studied and an alternating 
optimization is proposed to maximize the weighted sum-rate of the 
system. In (8), a two-user single stream MIMO interference chan- 
nel is considered and an alternating optimization is proposed where 
in each iteration the rate of one link is optimized while fixing the 
rate of the other link. The approach in [8 | has the advantage over 
the weighted sum-rate approach in achieving the points on the non- 
convex part of the rate region [10|. The algorithm in (8) is however 
not extensible to more than two links. Recently in |9], the necessary 
transmit covariance matrices to achieve all Pareto optimal points in 
MIMO interference channels are characterized and parameterized. 

We consider rate profile optimization for characterizing all 
Pareto optimal points in the A"-user single stream MIMO inter- 
ference channel rate region. Since this problem is nonconvex, we 
propose an alternating approach based on iteratively optimizing the 
transmit and receive beamforming vectors. For fixed receivers, the 
setting corresponds to the multiple-input single-output (MISO) in- 
terference channel and rate profile optimization is solved by a set of 
convex feasibility problems in 1 1 1 1 . For fixed transmit beamforming 
vectors, the setting corresponds to a single-input multiple-output 
(SIMO) interference channel. We show that the rate profile opti- 
mization in SIMO channels can be solved by a set of feasibility 
problems each corresponding to an inverse field of value problem. 
The alternating rate profile optimization is guaranteed to converge 
to a stationary point of the original problem. 

Outline: In Section [2] we describe the system model and state 
the problem formulation. In Section [3] rate profile optimization in 
MISO and SIMO interference channels are studied. The alternat- 
ing rate profile optimization algorithm is presented with numerical 
results in Section|4] In Section|5] we draw the conclusions. 



2. PRELIMINARIES 

Notations: Column vectors and matrices are given in lowercase and 
uppercase boldface letters, respectively. ||a|| is the Euclidean norm 
of a G C . |6| is the absolute value of b G C. (-) H denotes 
Hermitian transpose. I is an identity matrix. Define the collection 
{a} K := (oi, . . . , a\/c\). C7V(0, A) denotes a circularly-symmetric 
Gaussian complex random vector with covariance matrix A. 

2.1. System and Channel Model 

Consider a set A3 = {1, . . . , K} of interfering links. Each transmit- 
ter j uses rij antennas and each receiver k uses m k receive anten- 
nas. The flat fading channel matrix from transmitter j to receiver fc 
is Hjk G c m fc xn j w e assume that each transmitter transmits a 
single data stream to its intended receiver. The beamforming vector 
used at a transmitter j is Wj from the set 

Wj G Wj := {w G C" j : ||iu|| 2 < l}, (1) 

where we assumed a total transmit power constraint of one without 
loss of generality. The received signal at receiver k is written as 

Vk = 2_,. . H Hi- * + z k , (2) 

where Xj ~ C/V(0, 1) is the signal from transmitter j and z k ~ 
CAf(0,Io 2 ) is additive white Gaussian noise. The signal-to- 
interference-plus-noise ratio (SINR) at receiver k after equalization 
with the receive beamforming vector v k is 

At r i \ \ v k HkkWk\ 2 

Since the SINR in {5]) is not affected by the amplitude of the receive 
beamfonning vector, v k is chosen from the set 

v k G V fc := {v G C mfc : ||v|| 2 = l}, (4) 

where the receive power is normalized to one without loss of gener- 
ality. The achievable rate of link fc is 

R k (v k ,{w} K ) = log 2 (1 + 4> k (v k ,{w} K )), (5) 

where single-user decoding (SUD) is assumed at the receiver. The 
rate region 

TZ:= {(Ri(vi, {w} K ), . . .,R K (v K , {*0} k )) C E+ : 

w k g w k ,v k ev k ,keic}, (6) 

is the /•f-dimensional set composed of all achievable rate tuples. The 
set of Pareto optimal points in TZ is defined as 1121 p. 14] 

W(TZ) := {x G TZ : there is no y G TZ with y > x}, (7) 

with componentwise inequality in Q. At a Pareto optimal point it 
is impossible to strictly improve the performance of at least one user 
without degrading the performance of another user. The set of strong 
Pareto optimal points is a subset of the Pareto optimal points in Q 
and defined as: 

V{H) := {x G TZ : there is no y G TZ with y > x, y / x}, (8) 

where the inequality in ([8} is componentwise. An illustration of the 
Pareto boundary in a two-user rate region is given in Figure [T] 
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Fig. 1. Illustration of Pareto optimality in a two-user rate region. 
2.2. Problem Formulation 

Any point on the Pareto boundary of the rate region TZ can be at- 
tained by the solution of the rate profile optimization problerrQ 

maximize R (9a) 

{v} K> {w} K ,R 

s.t. R k (v k ,{w} K ) = a k R, fcG/C, (9b) 
w k eW k , v k £V k fcG/C. (9c) 

In (5), the rate profile (ai, . . . , ajf) satisfies a k > 0, fc G K, and 
X^feLi a k = 1. The objective R corresponds to the links' sum-rate. 
The rate profile specifies the direction for a ray starting in the ori- 
gin of the rate region, and the point of intersection of the ray and 
the Pareto boundary corresponds to the solution of the optimization 
problem. An illustration for the solution of a rate profile optimiza- 
tion is given in Figure[T] Solving the optimization problem in ([9} for 
all possible rate profiles achieves all points on the Pareto boundary 
of the rate region TZ. The problem in ((9) is however not convex, and 
hence no method is known that can attain its solution efficiently. 

We propose to decompose the problem in ((9} into two problems 
which are solved alternatingly. In the first problem, the transmit 
beamforming vectors which solve the rate profile optimizaiton prob- 
lem are found for fixed receive beamforming vectors. In the second 
problem, the receive beamforming vecotrs are optimized for fixed 
transmit beamforming vectors. Next, we discuss the two problems 
independently. Later in Section[4] the solutions of the two problems 
are used to construct the alternating algorithm. 

3. OPTIMALITY IN MISO AND SIMO CHANNELS 

3.1. Rate Profile Optimization in MISO Interference Channels 

In this section, we assume the receive beamforming vectors are fixed. 
The considered MIMO setting reduces to a MISO interference chan- 
nel, and the rate region is a subset of TZ defined as: 

ft MISO := {(Ri(v u {w} K ), Rk(v k , {w} k )) G TZ : 

w k eW k ,keTC}. (10) 

Rate profile optimization in MISO interference channels has been 
studied in 1111 . For a rate profile (ai, . . . , otic) the problem is 

maximize Rmko (Ha) 

s.t. R k (v k ,{w} K ) > a k R M iso, fcG/C, (lib) 
lOfcGWfc, fcG/C. (11c) 

'The rate profile approach has been first proposed for broadcast and 
multiple-access channels in (13 1 and for MISO interference channels in 1141 . 
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Fig. 2. Illustration of the solutions of rate profile optimization in 
two-user rate regions of MISO and SIMO interference channels. 

It is shown in 1 1 1 1 that the problem in dl It can be solved by a set of 
feasibility problems: 

find wk (12a) 

s.t. R k (v k ,{w} K ) >a k t, kelC, (12b) 

w k ew k , keK, (12c) 

where the parameter t > is updated based on a bisection method. 
The problem in d 1 2b is transformed in [11 Section II.D] to a sec- 
ond order cone programm (SOCP) and solved efficiently. The con- 
vex feasibility problem is used in [15 ] to characterize the necessary 
beamforming vectors to achieve all Pareto optimal points in MISO 
multicell settings with different transmit power constraints. 

In Figure |2j a), the rate profile optimization is illustrated. Note 
that only points on the strong Pareto boundary according to ((8} are 
achieved with i ll It . This is because the constraint in dl lbt is an 
inequality constraint as opposed to the equality constraint in d9b| l in 
the original problem. However, since at least one constraint in i ll lbt 
is satisfied with equality with the solution of i ll It . the value of the 
objective Ruiso is the same as for the optimization problem with the 
constraints in i9b\ replaced with equality constraints. 



3.2. Rate Profile Optimization in SIMO Interference Channels 

In this section, we assume the transmit beamforming vectors {w} K 
are fixed. The setting corresponds to a SIMO interference channel. 
The rate region in the SIMO setting is a subset of the rate region 7Z 
in l[6j and has the following property. 

Proposition 1 The rate region of a SIMO interference channel is a 
K -dimensional box: 

n s,MO = {(n, ■ ■ ■ , t k ) e n : r k < R k (vt MSE , {w} K ), k e K}, 

(13) 

where 



MMSE 

v k = 



l I + T J] ^ k H 3k w j wfHf k 



H kk w k 



° 2 I + E^ fc H ]kWj wfHf k ) l H hk v> k \ 



(14) 



Proof: The proof is provided in Appendix [A] □ 
In Figure[2](b), an illustration of a two-user SIMO interference 
channel rate region is plotted. The strong Pareto boundary accord- 
ing to l[8} consists of a single point corresponding to joint minimum 
mean square error (MMSE) receive beamforming. The rate profile 



Algorithm 1: Alternating rate profile optimization. 
Input: rate profile {ct} K = (ai, . . . , cik ) and accuracy e 



1 Initialize: i 

2 repeat 



0; choose random {v} 



(0). 



/r,„i(»+i) 5(*+i)V 
(^{ujj^ ,K mso J, 



solve d I 1 b given {v}^ to get 
solve (H given {w}£ +1) to get ({v}£ +1) , ; 
i = i + 1; 



until R^,l 



5(0 ^ 



Output: {w}^,{v}^ 



optimization problem in SIMO interference channels is given slQ 
maximize -Rsimo (15a) 

s.t. R k (v k , {w}^) = a k R S iMo, k G K. (15b) 
v k £V k , keK. (15c) 

As in the MISO case, the problem in \\5\ can be solved by a set of 
feasibility problems: 

find vi,...,vk (16a) 
s.t. R k (v k ,{w} K ) = a k t, keK.. (16b) 
v k e V k , keK.. (16c) 

where the parameter t > is updated according to a bisection 
method. The problem in dl6t can be rewritten as 

find vi, . . . , vk (17a) 
s.t. v k Q k {t)v k = 0, keK. (17b) 
v k e Vk, ke K, (17c) 

where the constraint in i ll 6b) has been reformulated to dl7bl with 

QM = H kk w k w k H kk 

~ (2 Qfct - I ) (/=•'/ ' Y.,..., //,/"•.»•'''//!!). (18) 

The problem in dl7t is called the inverse field of values problem 
1171 II 81 . In order to check the feasibility of 1 1171 for a chosen t, it 
suffices to test whether G J-(Q k (t)), where T(Q k (t)) is the field 
of values of Q k (t) defined in d24t in Appendix [A] Testing whether 
G J-(Q k (t)) is equivalent to checking whether zero lies between 
the smallest and largest eigenvalues of Q k (t). Hence, in order to 
determine the optimal t through a bisection approach, the complexity 
of the feasibility problem in d!7t corresponds to the complexity of 
an eigenvalue decomposition of Q k (t). After the convergence of 
the bisection method which determines the optimal t, each receive 
beamforming vector v k is determined by the algorithm in [ 17] which 
solves the inverse field of values problem. The algorithm requires 
five eigenvalue decompositions 1 17. Section 5]. 

4. ALTERNATING OPTIMIZATION 

The alternating rate profile algorithm is described in Algorithm Q] 
Given the receive beamforming vectors, the transmit beamform- 
ing vectors are updated according to Problem (111) . The optimized 



2 Rate profile optimization in SIMO interference channels has been con- 
sidered in 1161 Section IV.B]. The problem is solved by a set of feasibility 
problems which are related to SINR balancing problems. 
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points achieved by iterative 
weighted MMSE [7] 
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Fig. 3. Plot of two user rate region at dB SNR and two antennas at 
each transmitter and receiver. 




Fig. 4. A plot of a three user rate region at dB SNR and two 
antennas at each transmitter and receiver. 



transmit beamforming vectors are then fixed to solve for the receive 
beamforming vectors according to Problem ( 115V Note that updat- 
ing the receive beamforming vectors in each iteration according to 
MMSE beamforming in < 14b is not appropriate since the achieved 
rate tuple after the receiver optimization would not be along the rate 
profile direction. 

In Algorithm [TJ the measures R^so an d -^simo f° r MISO and 
SIMO rate profile optimization correspond to the distances from the 
origin to the Pareto boundary along the ray in the direction of the rate 



profile. In each iteration i, an improvement R, 



R 



(i) 



> must 



be achieved. If the improvement is less than an accuracy measure e, 
then the algorithm terminates. Since the rate region is a bounded set, 
the alternating algorithm is guaranteed to converge according to the 
monotone convergence theorem. 

Theorem 1 The alternating rate profile optimization in Algorithm 
{TJ converges to a stationary point of the original problem in ((9). 

Proof: The proof follows similar steps as the proof of fT9] Proposi- 
tion 1], and will be provided in 1201 . □ 

In Figure [3] a two-user rate region is plotted. All transmitters 
and receivers use two antennas and the signal-to-noise ratio (SNR), 
defined as 1/ct 2 , is dB. Single random channel matrix realisations 
are selected. The cloud of points in Figure [3]correspond to random 
norm-one transmit beamforming vectors with MMSE receive beam- 
forming. For a selected rate profile and accuracy measure e = 10 _J , 
the solutions of the transmitter and receiver optimizations are plotted 
during the alternating optimization. The performance improvement 
in each iteration can be observed and the alternating optimization 
terminates at a point very close to the Pareto boundary. 

For 50 different samples of rate profiles, we are able to plot the 
points on the Pareto boundary of the rate region in Figure [3] We 
choose the initial receive beamforming vectors {i?}/^' according to 
the dominant left eigenvectors of the corresponding direct channel 
matrices. However, since the quality of the solution of the alter- 
nating algorithm depends on the initial choice of the receive beam- 
forming vectors, it is also possible to run the algorithm for different 
random initial receive beamforming vectors and then choose the so- 
lution with the best performance. In Figure|3] the points plotted with 
the red cross correspond to the iterative weighted MMSE algorithm 
proposed in [7|. The approach in [7| optimizes the weighted sum- 
rate and hence points on the nonconvex part of the Pareto boundary 
are not achieved. In Figure [4] we plot a three dimensional rate re- 
gion. The transmitters and receivers use two antennas each, and the 



SNR is dB. For 121 rate profile samples, the Pareto boundary is 
obtained using the alternating rate profile algorithm. 



5. CONCLUSIONS 

We have considered the AT-user single stream MIMO interference 
channel. In this setting, achieving Pareto optimal points through 
rate profile optimization is a nonconvex problem. We have pro- 
posed an alternating optimization algorithm; For fixed receivers, we 
used existing results on rate profile optimization in MISO channels. 
For fixed transmitters, we show that rate profile optimization can be 
solved by a set of feasibility problems each corresponding to an in- 
verse field of value problem. The proposed alternating rate profile 
optimization is guaranteed to converge to a local optimum. 

A. PROOF OF PROPOSITION 1 

The achievable rate of link k depends only on its receive beam- 
forming vector Vk (given that {ifj^ are fixed). Thus, we have 
to show that the achievable rate of a link k takes values between 
[0, R k (vf MSE , {w} K )] for all v k G V k . Since the achievable rate of 
link k in l[5} is monotonically increasing in SINR, it is sufficient to 
analyze the SINR expression in l[3) for the proof. We reformulate 
the SINR of a link k as 



cj> k (v k ,{w} K ) 



v k A k v k 
v"B k v k ' 



(19) 



where 



H kk w k w k H kk 



(20) 
(21) 



B k = (a 2 1 + H dk WjwfHf k ^ 

Since B k is full rank, we can transform dl9t to a Rayleigh-Ritz ratio 

_ i 

[21 , Chapter 4.2] by substituting v k = B k 2 z k to get 

-»B-?A k B-iz h 



4> k (vk,{w} K ) 



z,, z k 



(22) 



From the Rayleigh-Ritz Theorem for Hermitian matrices ||2T1 Theo- 
rem 4.2.2] follows that 



4> k {v k ,{w} K )eF[B k 2 A k Bl 



(23) 



where the set J-(X) is the field of values of a matrix X defined as 
(22l Chapter 1]: 

T(X) — ^x H Xx 6 K : ||a;|| 2 = l\. (24) 

The field of values J-(X) is a compact convex set. If X is Her- 
mitian, then J~(X) C M with the smallest element and largest 

element corresponding to the smallest and largest eigenvalues of 

_ i _ i 

the matrix X, respectively. Since B k 2 A k B k 2 is a rank-one 

positive semi-definite matrix, then the SINR in J22t takes val- 

_ i _i 

ues between zero and the largest eigenvalue of B k 2 A k B k 2 . 
With A k given in J20b . the SINR in d22b is maximized by z k — 

B h 2 H kk w k which is the dominant (not normalized) eigenvector 

of B k 2 H kk w k w k H kk B k 2 . Substituting z k in v k = B k 2 z k 
and normalizing v k we get the expression in dl4l i. 

B. REFERENCES 

[1] G. Scutari, D. Palomar, and S. Barbarossa, "Competitive de- 
sign of multiuser MIMO systems based on game theory: A 
unified view," IEEE J. Sel. Areas Commun., vol. 26, no. 7, pp. 
1089-1103, Sep. 2008. 

[2] D. Schmidt, C. Shi, R. A. Berry, M. L. Honig, and W. Utschick, 
"Distributed resource allocation schemes," IEEE Signal Pro- 
cess. Mag., vol. 26, no. 5, pp. 53-63, Sep. 2009. 

[3] Z. K. M. Ho and D. Gesbert, "Balancing egoism and altruism 
on the interference channel: The MIMO case," in Proc. IEEE 
ICC, May 2010, pp. 1-5. 

[4] S. W. Peters and R. W. Heath, Jr., "Cooperative algorithms for 
MIMO interference channels," IEEE Trans. Veh. Tech., vol. 60, 
no. 1, pp. 2006-218, Jan. 2011. 

[5] Y.-F. Liu, Y.-H. Dai, and Z.-Q. Luo, "Coordinated beamform- 
ing for MISO interference channel: Complexity analysis and 
efficient algorithms," IEEE Trans. Signal Process., vol. 59, no. 
3, pp. 1142-1157, Mar. 2011. 

[6] Y.-F. Liu, Y.-H. Dai, and Z.-Q. Luo, "Max-min fairness linear 
transceiver design for a multi-user MIMO interference chan- 
nel," in Proc. IEEE ICC, Jun. 201 1. 

[7] Q. Shi, M. Razaviyayn, Z.-Q. Luo, and C. He, "An iteratively 
weighted MMSE approach to distributed sum-utility maxi- 
mization for a MIMO interfering broadcast channel," IEEE 
Trans. Signal Process., vol. 59, no. 9, pp. 4331-4340, Sep. 
2011. 

[8] R Cao, E. A. Jorswieck, and S. Shi, "On the Pareto bound- 
ary for the two-user single-beam MIMO interference channel," 
IEEE Trans. Signal Process., 2012, Revised Nov. 2012. Avail- 
able online at http://arxiv.org/abs/1202.5474. 



[9] J. Park and Y. Sung, "On the Pareto-optimal beam structure 
and design for multi-user MIMO interference channels," IEEE 
Trans. Signal Process., 2012, submitted. Available online at 
http ://arxiv. org/pdf/ 1211.4213. 

[10] I. Das and J. E. Dennis, "A closer look at drawbacks of mini- 
mizing weighted sums of objectives for Pareto set generation in 
multicriteria optimization problems," Structural optimization, 
vol. 14, no. 1, pp. 63-69, Aug. 1997. 

[11] J. Qiu, R. Zhang, Z.-Q. Luo, and S. Cui, "Optimal distributed 
beamforming for MISO interference channels," IEEE Trans. 
Signal Process., vol. 59, no. 11, pp. 5638-5643, Nov. 201 1. 

[12] H. J. M. Peters, Axiomatic Bargaining Game Theory, vol. 9 
of Game Theory, Mathematical Programming and Operations 
Research, Kluwer Academic Publishers, 1992. 

[13] M. Mohseni, Rui Zhang, and J.M. Cioffi, "Optimized trans- 
mission for fading multiple-access and broadcast channels with 
multiple antennas," IEEE J. Sel. Areas Commun., vol. 24, no. 
8, pp. 1627-1639, Aug. 2006. 

[14] R. Zhang and S. Cui, "Cooperative interference management 
with MISO beamforming," IEEE Trans. Signal Process., vol. 
58, no. 10, pp. 5454-5462, Oct. 2010. 

[15] E. Bjornson, M. Bengtsson, and B. Ottersten, "Pareto char- 
acterization of the multicell MIMO performance region with 
simple receivers," IEEE Trans. Signal Process., vol. 60, no. 8, 
pp. 4464-4469, Aug. 2012. 

[16] L. Liu, R. Zhang, and K.-C. Chua, "Achieving global optimal- 
ity for weighted sum-rate maximization in the K-user Gaus- 
sian interference channel with multiple antennas," IEEE Trans. 
Wireless Commun., vol. 11, no. 5, pp. 1933-1945, May 2012. 

[17] R. Carden, "A simple algorithm for the inverse field of val- 
ues problem," Inverse Problems, vol. 25, no. 11, pp. 115019- 
115027, 2009. 

[18] C. Chorianopoulos, P. Psarrakos, and F. Uhlig, "A method for 
the inverse numerical range problem," Electronic Journal of 
Linear Algebra, vol. 20, pp. 198-206, Mar. 2010. 

[19] M. Razaviyayn, M. Hong, and Z.-Q. Luo, "Linear 
transceiver design for a MIMO interfering broadcast chan- 
nel achieving max-min fairness," 2012, Available online at 
http://arxiv.org/abs/1208.6357. 

[20] R. Mochaourab, P. Cao, and E. A. Jorswieck, "Aternating rate 
profile optimization in single stream MIMO interference chan- 
nels," IEEE Trans. Signal Process., in preparation. 

[21] R. A. Horn and C. R. Johnson, Matrix Analysis, Cambridge 
Univ. Press, Cambridge, 1985. 

[22] R. A. Horn and C. R. Johnson, Topics in Matrix Analysis, Cam- 
bridge Univ. Press, Cambridge, 1991. 



